Organizing recurrent network dynamics by task-computation to enable continual learning

Biological systems face dynamic environments that require continual learning. It is not well understood how these systems balance the tension between flexibility for learning and robustness for memory of previous behaviors. Continual learning without catastrophic interference also remains a challenging problem in machine learning. Here, we develop a novel learning rule designed to minimize interference between sequentially learned tasks in recurrent networks. Our learning rule preserves network dynamics within activity-defined subspaces used for previously learned tasks. It encourages dynamics associated with new tasks that might otherwise interfere to instead explore orthogonal subspaces, and it allows for reuse of previously established dynamical motifs where possible. Employing a set of tasks used in neuroscience, we demonstrate that our approach successfully eliminates catastrophic interference and offers a substantial improvement over previous continual learning algorithms. Using dynamical systems analysis, we show that networks trained using our approach can reuse similar dynamical structures across similar tasks. This possibility for shared computation allows for faster learning during sequential training. Finally, we identify organizational differences that emerge when training tasks sequentially versus simultaneously

Cube law, condition factor and weight-length relationships: history, meta-analysis and recommendations

This study presents a historical review, a meta-analysis, and recommendations for users about weight–length relationships, condition factors and relative weight equations. The historical review traces the developments of the respective concepts. The meta-analysis explores 3929 weight–length relationships of the type W = aLb for 1773 species of fishes. It shows that 82% of the variance in a plot of log a over b can be explained by allometric versus isometric growth patterns and by different body shapes of the respective species. Across species median b = 3.03 is significantly larger than 3.0, thus indicating a tendency towards slightly positive-allometric growth (increase in relative body thickness or plumpness) in most fishes. The expected range of 2.5 < b < 3.5 is confirmed. Mean estimates of b outside this range are often based on only one or two weight–length relationships per species. However, true cases of strong allometric growth do exist and three examples are given. Within species, a plot of log a vs b can be used to detect outliers in weight–length relationships. An equation to calculate mean condition factors from weight–length relationships is given as Kmean = 100aLb−3. Relative weight Wrm = 100W/(amLbm) can be used for comparing the condition of individuals across populations, where am is the geometric mean of a and bm is the mean of b across all available weight–length relationships for a given species. Twelve recommendations for proper use and presentation of weight–length relationships, condition factors and relative weight are given

Phenotyping of Left and Right Ventricular Function in Mouse Models of Compensated Hypertrophy and Heart Failure with Cardiac MRI

Background: Left ventricular (LV) and right ventricular (RV) function have an important impact on symptom occurrence, disease progression and exercise tolerance in pressure overload-induced heart failure, but particularly RV functional changes are not well described in the relevant aortic banding mouse model. Therefore, we quantified time-dependent alterations in the ventricular morphology and function in two models of hypertrophy and heart failure and we studied the relationship between RV and LV function during the transition from hypertrophy to heart failure. Methods: MRI was used to quantify RV and LV function and morphology in healthy (n = 4) and sham operated (n = 3) C57BL/6 mice, and animals with a mild (n = 5) and a severe aortic constriction (n = 10). Results: Mice subjected to a mild constriction showed increased LV mass (P0.05). Animals with a severe constriction progressively developed LV hypertrophy (P<0.001), depressed LVEF (P<0.001), followed by a declining RVEF (P<0.001) and the development of pulmonary remodeling, as compared to controls during a 10-week follow-up. Myocardial strain, as a measure for local cardiac function, decreased in mice with a severe constriction compared to controls (P<0.05). Conclusions: Relevant changes in mouse RV and LV function following an aortic constriction could be quantified using MRI. The well-controlled models described here open opportunities to assess the added value of new MRI techniques for the diagnosis of heart failure and to study the impact of new therapeutic strategies on disease progression and symptom occurrence

Myocardial perfusion MRI shows impaired perfusion of the mouse hypertrophic left ventricle

There is growing consensus that myocardial perfusion deficits play a pivotal role in the transition from compensated to overt decompensated hypertrophy. The purpose of this study was to systematically study myocardial perfusion deficits in the highly relevant model of pressure overload induced hypertrophy and heart failur

Interferometry with Bose-Einstein Condensates in Microgravity

Atom interferometers covering macroscopic domains of space-time are a spectacular manifestation of the wave nature of matter. Due to their unique coherence properties, Bose-Einstein condensates are ideal sources for an atom interferometer in extended free fall. In this paper we report on the realization of an asymmetric Mach-Zehnder interferometer operated with a Bose-Einstein condensate in microgravity. The resulting interference pattern is similar to the one in the far-field of a double-slit and shows a linear scaling with the time the wave packets expand. We employ delta-kick cooling in order to enhance the signal and extend our atom interferometer. Our experiments demonstrate the high potential of interferometers operated with quantum gases for probing the fundamental concepts of quantum mechanics and general relativity.Comment: 8 pages, 3 figures; 8 pages of supporting materia

Comparative and functional analysis of intron-mediated enhancement signals reveals conserved features among plants

Introns in a wide range of organisms including plants, animals and fungi are able to increase the expression of the gene that they are contained in. This process of intron-mediated enhancement (IME) is most thoroughly studied in Arabidopsis thaliana, where it has been shown that enhancing introns are typically located near the promoter and are compositionally distinct from downstream introns. In this study, we perform a comprehensive comparative analysis of several sequenced plant genomes. We find that enhancing sequences are conserved in the multi-cellular plants but are either absent or unrecognizable in algae. IME signals are preferentially located towards the 5′-end of first introns but also appear to be enriched in 5′-UTRs and coding regions near the transcription start site. Enhancing introns are found most prominently in genes that are highly expressed in a wide range of tissues. Through site-directed mutagenesis in A. thaliana, we show that IME signals can be inserted or removed from introns to increase or decrease gene expression. Although we do not yet know the specific mechanism of IME, the predicted signals appear to be both functional and highly conserved

Serial Coronary Imaging of Early Atherosclerosis Development in Fast-Food-Fed Diabetic and Nondiabetic Swine

Patients with diabetes mellitus (DM) are at increased risk for atherosclerosis-related events compared to non-DM (NDM) patients. With an expected worldwide epidemic of DM, early detection of anatomic and functional coronary atherosclerotic changes is gaining attention. To improve our understanding of early atherosclerosis development, we studied a swine model that gradually developed coronary atherosclerosis. Interestingly, optical coherence tomography, near-infrared spectroscopy (NIRS), vascular function, and histology demonstrated no differences between development of early atherosclerosis in fast-food-fed (FF) DM swine and that in FF-NDM swine. Coronary computed tomography angiography did not detect early atherosclerosis, but optical coherence tomography and near-infrared spectroscopy demonstrated coronary atherosclerosis development in FF-DM and FF-NDM swine

Intervening with the Nitric Oxide Pathway to Alleviate Pulmonary Hypertension in Pulmonary Vein Stenosis

Pulmonary hypertension (PH) as a result of pulmonary vein stenosis (PVS) is extremely difficult to treat. The ideal therapy should not target the high-pressure/low-flow (HP/LF) vasculature that drains into stenotic veins, but only the high-pressure/high-flow (HP/HF) vasculature draining into unaffected pulmonary veins, reducing vascular resistance and pressure without risk of pulmonary oedema. We aimed to assess the activity of the nitric oxide (NO) pathway in PVS during the development of PH, and investigate whether interventions in the NO pathway differentially affect vasodilation in the HP/HF vs. HP/LF territories. Swine underwent pulmonary vein banding (PVB; n = 7) or sham surger